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OBDD-based graph algorithms deal with the characteristic function of 
the edge set E of a graph G = (V, E ) which is represented by an OBDD 
and solve optimization problems by mainly using functional operations. We 
present an OBDD-based algorithm which uses randomization for the first 
time. In particular, we give a maximal matching algorithm with 0(log 3 |V|) 
functional operations in expectation. This algorithm may be of independent 
interest. The experimental evaluation shows that this algorithm outperforms 
known OBDD-based algorithms for the maximal matching problem. 

In order to use randomization, we investigate the OBDD complexity of 
2 n (almost) fc-wise independent binary random variables. We give a OBDD 
construction of size 0(n) for 3-wise independent random variables and show 
a lower bound of 2°^ on the OBDD size for k > 4. The best known lower 
bound was Vt{2 n /n) for k ~ logn due to Kabanets [23]. We also give a very 
simple construction of 2 n (e, k )-wise independent binary random variables by 
constructing a random OBDD of width 0(nk 2 /e). 
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1 Introduction 


In times of Big Data, classical algorithms for optimization problems quickly exceed feasi¬ 
ble running times or memory requirements. For instance, the rapid growth of the Internet 
and social networks results in massive graphs which traditional algorithms cannot pro¬ 
cess in reasonable time or space. In order to deal with such graphs, implicit (symbolic) 
algorithms have been investigated where the input graph is represented by the character¬ 
istic function xe of the edge set and the nodes are encoded by binary numbers. Using 
Ordered Binary Decision Diagrams (OBDDs), which were introduced by Bryant [12], 
to represent xe can significantly decrease the space needed to store such graphs. Fur¬ 
thermore, using mainly functional operations, e. g., binary synthesis and quantifications, 
which are efficiently supported by the OBDD data structure, many optimization prob¬ 
lems can be solved on OBDD represented inputs ( [TT], [18] [20] [35] [36] [37] 02]). Implicit 
algorithms were successfully applied in many areas, e.g., model checking [13], integer 
linear programming [25] and logic minimization (I5j . With one of the first implicit 
graph algorithms, Hachtel and Somenzi ESI were able to compute a maximum flow on 
0-1-networks with up to 10 36 edges and 10 2 ' nodes in reasonable time. 

There are two main parameters influencing the actual running time of OBDD-based 
algorithms: the number of functional operations and the sizes of all intermediate OBDDs 
used during the computation. The size of OBDDs representing graphs was investigated 
for bipartite graphs [33], interval graphs [33] [19], cographs [33] and graphs with bounded 
tree- and clique-width [29]. Bounding the sizes of the other OBDDs, which can occur 
during the computation, is quite difficult and could only be proven for very structured 
input graphs like grid graphs 181132]. In terms of functional operations, Sawitzki [38 ] 
showed that the set of problems solved by an implicit algorithm using 0(log k N) func¬ 
tional operations and functions defined on O (log IV) variables is equal to the complexity 
class FNC, i.e., the class of all optimization problems that can be efficiently solved 
in parallel. Implicit algorithms with these properties were designed for instance for 
topological sorting [42], minimum spanning tree [6], metric TSP approximation [7] and 
maximal matching D33 where a matching M, i. e., a set of edges without a common ver¬ 
tex, is called maximal if M is no proper subset of another matching. However, Sawitzki’s 
structural result yields neither a good transformation of parallel algorithms to implicit 
algorithms nor does it give a statement about the actual performance of the implicit 
algorithms. Nevertheless, designing implicit algorithms for optimization problems is not 
only an adaption of parallel algorithms but can give new insights into the problems. 
For example, Gentilini et al. fTS] introduced a new notion of spine-sets in the context 
of implicit algorithms for connectivity related problems. When analyzing implicit algo¬ 
rithms, the actual running time can either be proven for very structured input graphs 
like [32] clid for topological sorting and [8] for maximum matching or the running time 
is experimentally evaluated like in [20] for maximum flows and in isi ns] for maximum 
matching on bipartite graphs or unit interval graphs. 

Overall there seems to be a trade-off: The number of operations is an important 
measure of difficulty [5] but decreasing the number of operations often results in an 
increase of the number of variables of the used functions. Since the worst case OBDD size 
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of a function / : {0, l} n —y {0,1} is 0(2 n /n), the number of variables should be as small 
as possible to decrease the worst case running time. This trade-off was also empirically 
observed. For instance, an implicit algorithm computing the transitive closure that 
uses an iterative squaring approach and a polylogarithmic number of operations is often 
inferior to an implicit sequential algorithm, which needs a linear number of operations in 
worst case mm- Another example is the maximal matching algorithm (BP) of Bollig 
and Proger [10] that uses only 0(log 4 N ) functional operations on functions with at most 
6 log A" variables while the algorithm (HS) of Hachtel and Somenzi [20] uses 0(N log N) 
operations in the worst case on function with at most 3 log A" variables. However, HS is 
clearly superior to BP on most instances (see Section [5]). An additional reason might be 
its simplicity. 

Using randomization in an explicit algorithm often leads to simple and fast algorithms. 
Here, we propose the first attempt at using randomization to obtain algorithms which 
have both a small number of variables and a small expected number of functional op¬ 
erations. For this, we want to represent random functions f r : {0,1} TI —y {0,1} with 
Pr lf r (x) — 1] — p for every x G {0, l} n and some fixed probability 0 < p < 1 by OBDDs. 
Using random functions in implicit algorithms is difficult. We need to construct them 
efficiently but, obviously, if the function values are completely independent (and p is a 
constant), then the OBDD (and even the more general FBDD or read-once branching 
program) size of f r is exponentially large with an overwhelming probability [4UJ. Thus, 
we investigate the OBDD size and construction of (almost) k -wise independent random 
functions where the distribution induced on every k different function values is (almost) 
uniform. 

Related Work 

A succinct representation of 2 n random bits, which are fc-wise independent, was presented 
by Alon et al. [I] using \_k/2\n + 1 independent random bits. This number of random 
bits is very close to the lower bound of Chor and Goldreich [13]. In order to reduce 
the number of random bits even further, Naor and Naor bh introduced the notion of 
almost k -wise independence where the distribution on every k random bits is “close” to 
uniform. Constructions of almost k -wise independent random variables are also given in 
|2] and are using only at most 2(log n + log k + log(1/t)) random bits where £ is a bound 
on the closeness to the uniform distribution. Looking for a simple representation of 
almost k -wise independent random variables, Savicky [33] presented a Boolean formula of 
constant depth and polynomial size and used n log 2 k \og(l/e) random bits. In all of these 
constructions, the running time of computing the i-t\i random bit with 0 < i < 2 n — 1 
depends on k and e. 

Such small probability spaces can be used for a succinct representation of a random 
string of length 2 n , e.g., in streaming algorithms [3], or for derandomization mm- 
The randomized parallel algorithms from mm compute a maximal independent set 
(MIS) of a graph, i. e., a subset I of V such that no two nodes of / are adjacent and any 
vertex in G is either in / or is adjacent to a node of /. The computation of a MIS has 
also been extensively studied in the area of distributed algorithms [3ES]. An optimal 
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randomized distributed MIS algorithm was presented in [30j where the time and bit 
complexity (bits per channel) is 0(log N). Using completely independent random bits, 
Israeli and Itai |22j give a randomized parallel algorithm computing a maximal matching 
in time O(loglV). 

While we are looking for fc-wise independent functions with small OBDD size, Ka- 
banets m constructed simple Boolean functions which are hard for FBDDs by inves¬ 
tigating (almost) ©(n)-wise independent random functions and showed that the proba¬ 
bility tends to 1 as n grows that the size is Q(2 n /n). 

Our Contribution. 

In Section [3} we show that the OBDD and FBDD size is at least 2 n( ' n+log ^ p '^ with 
p' = 2p(l —p) if the function values of f r are fc-wise independent with k > 4. We give an 
efficient construction of OBDDs for 3-wise independent random functions which is based 
on the known construction of 3-wise independent random variables using BCH-schemes 
p]. I 11 Section [d] we investigate a simple construction of a random OBDD due to Bollig 
and Wegener m which generates almost /e-wise independent random functions and has 
size 0((kn) 2 /e). Reading the actual value of the i-th random bit is just an evaluation of 
the function on input i which can be done in 0(n) time, i. e., it is independent of both 
k and e. This construction is used as an input distribution for our implicit algorithm in 
the experimental evaluation. I 11 Section [5] we use pairwise independent random functions 
to design a simple maximal matching algorithm that uses only 0(log 3 N) functional op¬ 
erations in expectation and functions with at most 3 log N variables. This algorithm can 
easily be extended to the MIS problem and can be implemented as a parallel algorithm 
using 0(log N) time in expectation or as a distributed algorithm with O (log IV) expected 
time and bit complexity (and is simpler than in [30]). To the best of our knowledge, this 
is the first (explicit or implicit) maximal matching (or independent set) algorithm that 
does not need any knowledge about the graph (like size or node degrees) as well as uses 
only pairwise independent random variables. Eventually, we evaluate this algorithm em¬ 
pirically and show that known implicit maximal matching algorithms are outperformed 
by the new randomized algorithm. 

2 Preliminaries 

Binary Decision Diagrams 

We denote the set of Boolean functions / : {0, l} n — > {0,1} by B n . For x G {0, l} n 
denote the value of x by |x| := x i ' 2*. Further, for I G N, we denote by [Z] 2 the 

corresponding binary number of I, i.e., |[/] 2 | = I. In his seminal paper 1 12] , Bryant 
introduced Ordered Binary Decision Diagrams (OBDDs), that allow a compact repre¬ 
sentation of not too few Boolean functions and also supports many functional operations 
efficiently. 
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Definition 2.1 (Ordered Binary Decision Diagram (OBDD)). 

Order. A variable order tt on the input variables X = {xo,... ,x n _i} of a Boolean 
function / G B n is a permutation of the index set / = {0,..., n — 1}. 

Representation. A n-OBDD is a directed, acyclic, and rooted graph G with two 
sinks labeled by the constants 0 and 1. Each inner node is labeled by an input variable 
from X and has exactly two outgoing edges labeled by 0 and 1. Each edge ( Xi,Xj ) has 
to respect the variable order ^ r, i. e., 7r(z) < 7r(j). 

Evaluation. An assignment a G {0, l} n of the variables defines a path from the 
root to a sink by leaving each ay-node via the ay-edge. A 7T-OBDD Gf represents / iff 
for every a G {0, l} n the defined path ends in the sink with label /(a). 

Complexity. The size of a 7T-OBDD G, denoted by |G|, is the number of nodes in 
G. The 7T-OBDD size of a function / is the minimum size of a 7T-OBDD representing 
/. The OBDD size of / is the minimum 7T-OBDD size over all variable orders n. The 
width of G is the maximum number of nodes labeled by the same input variable. 

The more general read-once branching programs or Free Binary Decision Diagrams 
(FBDDs) were introduced by Masek [28]. In an FBDD every variable can only be read 
once on a path from the root to a sink (but the order is not restricted). 

A simple function is the inner product IP n (x, y ) = 0" =o 1 ay A y t of two vectors i,i/G 
{0, l} n . Let 7T be a variable order where for every 0 < i < n, the variables ay and 
are consecutive. It is easy to see that the 7T-OBDD representing IP n has size O(n) and 
width 2. Notice that the 7T-OBDD size is still 0(n ) if we replace an input vector, e.g., 
y, by a constant vector r G {0, l} n . 

In the following we describe some important operations on Boolean functions which 
we will use in this paper (see, e. g., Section 3.3 in [H] for a detailed list). Let / and g be 
Boolean functions in B n on the variable set X = {xo,..., x n _i}, 7r a fixed order and let 
Gf and G g be 7 t-OBDDs representing / and g, respectively. We denote the subfunction 
of / where Xj for some 0 < j < n — 1 is replaced by a constant a G {0,1} by f\ Xj=a - 

1. Negation: Given Gf, compute a representation for the function / G B n . Time: 
0(1) 

2. Replacement by constant: Given Gf, an index i G {0,..., n— 1}, and a Boolean 
constant c* G {0,1}, compute a representation for the subfunction f\ Xi=Ci . Time: 

0(\G f \) 

3. Equality test: Given Gf and G g , decide whether / and g are equal. Time: 0(1) 
in most implementations (when using so called Shared OBDDs, see [IT]), otherwise 
0(\G f \ + \G g \). 

4. Synthesis: Given Gf and G g and a binary Boolean operation g) G B 2 , compute a 
representation for the function h G B n defined as h := f ®g. Time: 0(|G/| • \G g \) 

5. Quantification: Given Gf, an index i G {1,... ,n} and a quantifier Q G {3, V}, 
compute a representation for the function h G B n defined as h := Qxi : / where 
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3xi : f \= f\ Xi=0 V f\ Xi= i and \/xi : / := f\ Xi=0 A f\ Xi =i- Time: see replacement by 
constant and synthesis 

In addition to the operations mentioned above, in implicit graph algorithms (see the 
next section) the following operation (see, e.g., [27]) is useful to reverse the edges of a 
given graph. We will use this operation implicitly by writing for instance f(x,y) and 
f(y,x ) in the pseudo code of our algorithm. 

Definition 2.2. Let k G FT, p be a permutation of {1,..., k} and / G B^ n with input 
vectors x^\ ... ,x^ G {0, l} n . The argument reordering 7 Z p (f) G Bk n with respect to p 
is defined by 7 Z p (f)(x^\ ... ,x^) := f(x^ p ^\ ... , xO(fc))). 

This operation can be computed by just renaming the variables and repairing the variable 
order using 3 (k — 1 )n functional operations (see [9]). 

A function f depends essentially on a variable Xi iff f\ Xi =o f\ Xi = i- A characterization 
of minimal 7r-OBDDs due to Sicling and Wegener [39] can often be used to bound the 
OBDD size. 

Theorem 2.3 (j39j). Let f G B n and for all i — 0,..., n — 1 let s* be the number of 
different subfunctions which result from replacing all variables x n ^ with 0 < j < i — 1 by 
constants and which essentially depend on x w ^). Then the minimal tt-OBDD representing 
f has Si nodes labeled by x^y 

Lower bound techniques for FBDDs are similar but have to take into account that the 
order can change for different paths. The following property due to Jukna [23] can be 
used to show good lower bounds for the FBDD size. 

Definition 2.4. A function / G B n with input variables X = {^o,... ,x n _i} is called 
r-mixed if for all V C X with |V| = r the 2 r assignments to the variables in V lead to 
different subfunctions. 

Lemma 2.5 ([23]). The FBDD size of a r-mixed function is bounded below by 2 r — 1. 

OBDD-Based Graph Algorithms 

Let G = (V, E) be a directed graph with node set V = {n 0 ,..., rtv-i} and edge set 
E C V x V. Here, an undirected graph is interpreted as a directed symmetric graph. 
Implicit algorithms work on the characteristic function \e £ B 2n of E where n = [log N~\ 
is the number of bits needed to encode a node of V and \E(x,y) = 1 if and only if 
{ v \x\, v \y\) ^ E. Often it is also necessary to store the valid encodings of nodes by the 
characteristic function xv of V. Besides functional operations, OBDD-based algorithms 
can use 0(polylog |Vj) additional time, e.g., for constructing OBDDs for a specific 
function (equality, greater than, inner product, ...). 
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Small probability spaces 

A succinct representation of our random function is essential for our randomized implicit 
algorithm. For this, we have to used random f un ctions with limited independence. 

Definition 2.6 ((Almost) k -wise independence). Let X 0 ,..., X m _i be m binary random 
variables. These variables are called k-wise independent with k < m if and only if for 
all 0 < ii < ... ik < m — 1 and for all li, ..., l k G {0,1} 

Pr [X h = h A ... A X ik = l k ] = 2~ k 

and they are called (e, k)-wise independent iff 

|Pr [X,, = h A ... A X ik = l k ] - 2~ k \ < e. 

The BCH scheme introduced by Alon et. al [I] is a construction of A;-wise indepen¬ 
dent random variables X 0 ,...,X 2 ™_i that only needs [k/2\n + 1 independent ran¬ 
dom bits and works as follows: Let r n G {0,1} be a random bit, G {0, l} n for 
1 < j < l be l uniformly random row vectors, and let the row vector r = [r^,..., r®] G 
{0, l} ln+1 be the concatenation of the vectors. For 0 < i < 2 n — 1 define X, = 
IPin+i (r, [[z] 2 , [i 3 ] 2 ,..., [* 2i_1 ] 2 ]) © r 'n where i 2 ^ 1 for j = 1 ,..., l is computed in the 
finite field GF(2 n ). This scheme generates 21 + 1-wise independent random bits [T| (if 
we exclude A" 0 and if r n is dropped we obtain 2/-wise independence). 

We say a function f r : {0, l} n —>■ {0,1} is a fc-wise ((e, k)- wise) independent random 
function iff the random variables Xi = / r ([*] 2 ) with 0 < i < 2 n — 1 are k -wise ((e, k)- 
wise) independent. The BCH scheme gives us an intuition of the complexity of an OBDD 
representing a k -wise independent function: For k < 3 the random variables of the BCH 
scheme are Xi = IPi n+ 1 (r, [i] 2 ) © r n which is basically a simple inner product of two 
binary vectors. For k > 4, i. e., I > 2, we have to multiply in a finite field to generate the 
random variables. Since multiplication is hard for OBDDs it seems likely that k -wise 
independent functions for k > 4 are also hard. 

3 OBDD Size of /c-wise Independent Random Functions 

We start with some upper bounds on the OBDD size of 3-wise independent random 
functions. Notice that by means of the BCH scheme it is not possible to construct a 
pairwise independent function (which is not 3-wise independent) since A" 0 = /P(r, 0 n ) = 
0 for every r G {0, l} n . 
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Figure 1: Two 7 t-OBBDs with 7 r = (x 0 , y 0 ,..., x n _i, y n -f) for the functions IP 6 (x,y) 
where y is replaced by the constant vector (1, 0,1,1,0,1) and JP 2 (3b y). 


Theorem 3.1. Let £ > 0, n 6 N, p be a probability with l/2 n < p < 1/2, and n be a 
variable order on the input variables {x 0 ,... ,x n _i}. Define p(x) := Pr [f r (x) = 1]. 

re{o,i} n + 1 

1. We can construct an n-OBDD representing a 3-wise independent function f r : 
{0, l} n —> {0,1} in time 0(n ) such that p(x) = 1/2 for every x G {0, l} n , and the 
size of the n-OBDD is 0{n ) with width 2 for every r G {0, l} n+1 (see Algorithm 

0 - 

2. We can construct an n-OBDD representing a 3-wise independent function f r : 

{0, l} n —>- {0,1} in time such that ^ ^ < p(x) < (1 + e) ■ for every 

x G {0, l} n , and the size of the n-OBDD is bounded above by for every 

r G {0, l} n+1 . 

3. We can compute a function gA^x) : {0, l} n <= {0,1} for a random matrix 

\ v . 2 - 

A G {0, l} n x {0, l} n such that Pr [gA^x) = 1] = ——— using 0(n ) functional 

A. Z 

operations. Furthermore, using also 0(n ) functional operations we can compute a 
priority function GTA(x,y), which is equal to 1 iff \v x \ > \v y \, where v z G {0, l} n 
for all z G {0, l} n and ( vq ,... ,r^-i) is a pairwise independent random permuta¬ 
tion of { 0, l} n . Note: This construction is also possible using only 2n random bits 
by computing single bits of a 0 + |x| • ai in F 2 «. 

Proof. 1. This is an implication of the BCH scheme for 3-wise independent random 
bits. Recall that for random r = (ro,... ,r n ) G {0, l} n+1 the random variables Xf{r) = 
JP(r, [1, [z] 2 ]) for 0 < i < 2 n — 1 are 3-wise independent and Pr [Xf = 1] = 1/2 for every 

i. We define f r (x ) = A/ X |(r) (see Algorithm [l|. As described in the preliminaries, the 
function IP can be represented by an OBDD of width 2 and size 0(n ) for any variable 
order if one input vector is replaced by a constant vector. The construction of the OBDD 
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is straightforward (see, e.g., Fig. [Tj) and can be done in time 0{n). 

2. Let s G {0, l} n be the binary representation of \p ■ 2 n ], i. e., |s| = \p ■ 2"]. 
In order to approximate the probability p, we compute t = |~— logp — logs] random 
bits Cn-i(x ),..., c n -t(x) with q(x) = IP(x,r W) © r^ where the G {0, l} n and 
rii' 1 G {0,1} are chosen independently uniformly at random. Now, our random function 
f r (x ) is equal to 1 iff |c n _i ■ • • c n _ t 0 n_t | < |s|. In order to construct the OBDD for / r , we 
simulate the t OBDDs representing q on input x G {0, l} n in parallel: Since all OBDDs 
have width 2, we can represent the states of the OBDDs representing c n _i,..., c n - t after 
reading the same k input variables with at most 2 t OBDD nodes for each 1 < k < n. 
After reading all n input bits, we know the values of c n _i(x),..., c n _ t (x) and can easily 
decide whether |c n _i • • • c n _ t 0 ri_t | < |s| because s is a constant. Therefore, the overall 
OBDD size is 0{n ■ 2 l ) = Each q(x) is generated by a BCH scheme for 3-wise 

independent random bits and q(x) and Cj(x) are independent for i ^ j. Therefore, / r (x) 
is also 3-wise independent. 

Let p' G (0,1) such that 2 n ■ p’ is the value of the binary number consisting of the 
first t most significant bits of s followed by n — t ones, i. e., 2 n ■ p 1 = |s n _i • • • 

The function f r ignores the n — t least significant bits of s, therefore, it is equivalent to 
choose a random vector v G {0, l} n and check whether |w| < 2 n ■ p' which means that 
the probability of f r (x ) = 1 is p'. It is 

|s| < p' ■ 2 n < |s| + 2 n ~ t — 1 < \s\ + e ■ p ■ 2 n < (1 + e)|s| 


and thus 


r n • 2 n l 

— Pr [fr(x) = 1] 


p' < (1 + e) • 


\p ■ 2 n ] 

2 n 


3. For a random matrix A G { 0 , l} n x { 0 , l} n define q(x) — a[ ■ x — IP(di, x) where q 
is the i-th column vector of A. Let /a(x, i) = 1 iff q(x) = 1. An OBDD reading the bits 
of i first and then computing the corresponding value of q(x) has a size of 0(n 2 ) since 
each q(x) can be computed by an OBDD with width 2 (TODO: experiments suggest 
rather size of 0(n)). This OBDD can also be constructed in time 0(n 2 ). Let v x = Ax 
for x G {0, l} n . Now define GTa(x,i/) = 1 iff \v x \ > \v y \ , i. e., 


GT a (x, y) = 3 i : f A (x,i ) A f A (y,i ) A (Vj : (j > i) => (f A (x,i) f A (y,i ))). 


Since each component of v x and v y are pairwise independent, the entire random vectors 
are also pairwise independent. 

The function g A (x) can be constructed in the same way by replacing f A (y , i ) with b{i) 
which is equal to the i-th bit of \p ■ 2 n ] and a negation of the resulting function. □ 


Can we also construct small OBDDs for k- wise independent random variables with 
k > 4? Unfortunately, this is not possible. 

Theorem 3.2. Let X 0l ..., X 2 ™_i : S —> {0,1} be k-wise independent 0/1-random vari¬ 
ables over a sample space S with Pr [Xj = 1 ] = p for all 0 < j < 2 n — 1 and k > 4. For 

every s G S let f s : {0, l} n —> {0,1} be defined by f s (x ) := X| x |(s). Then, for a fixed 
variable order n, the expected n-OBDD size of f s is bounded below by Q(2 n ^ 3 ■ (p')^ 1 / 3 ^) 
with p' = 2p(l — p). 
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Algorithm 1 RandomFunc(x,n) 

Input: Variable vector x of length n £ N 
Output: 3-wise independent function r{x) 

Let r 0 ,_, r n be n + 1 independent random bits 

fr(x) = ©£>* A Xi) © r n 
return f r (x) 


Proof. For the sake of simplicity we omit the index of the function f r . W.l.o.g. let 
7T be the identity order, i.e. 7r(i) = i for all i = 0, ...,n — 1. For l e {1, ...,n} 
and a £ {0, l} 1 let f a : {0, l} n ~ l —» {0,1} be the subfunction of / where the first 
l variables x 0 ,...,xi _i are fixed according to a, i.e. f a (z ) := /|x 0 =« 0 ,...,x i _i=a i _i(^)- 
Now we fix two different assignments a, a' and define 2 n ~ l random variables D(z) : = 
D a ,a'{z) such that D(z) = 1 iff f a (z) ^ fa'(z). Since the function values of / are 
also k- wise independent, for every z £ {0, l} n " / we have E \D(z)] = 2p(l — p ) := p' 
and Var[D(z)\ = E[D(z ) 2 ] - E[D(z)} 2 = E[D(z)} - E[D(z)} 2 = p\l - p'). Let 
D = ^2 z D(z). We want to find an upper bound on the number of pairs (a, a 1 ) with 
fa = fa 1 - The probability that for fixed (a, a') the subfunctions are equal is bounded 
above by the probability that the difference between D and E [D] is at least E[D], 
i.e. Pr [f a = f a t) — Pr [D — 0] < Pr [| D — E[D\ \ > E [D]]. Each random variable D(z ) 

depends on two function values, i.e. these variables are k! = |_^/2_|-wise independent. 
Since k' > 2 we can use Chebyshev's inequality 

. Var [g] E, Car pW] 2-‘ ■ p- ■ (1 - p') 1 

U<* la _ ^^2 (2 a-l.p>)2 (2 n ~ l ■ p 1 ) 2 ~ 2 n ~ l ■ 


Hence, the expected number of pairs ( a , a') with f a = f a is bounded above by 2 nfi. p , < 
2 2 -i. p , ■ Therefore, the expected number t/ of functions which are equal can be bounded 
above by \J 2 n-i. p ’ = ^== = • The number si of different subfunctions f a is bounded 

below by 2 l divided by an upper bound on the number t[ of subfunctions f a which are 
equal, i. e., E [sj] > E where the last inequality is clue to Jensen’s inequality 

and the fact that g(x) = x is convex on (0,oo). The expected number of equal 
subfunctions can be lower than 1, therefore we have to do a case study: 


\/2 n ~ l ■ p’ 

expectation) 


<!<=>/< (l/3)(n + log(//)): All 2 l subfunctions are different (in 



The number of different subfunctions is at least 
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For the sake of simplicity, we assume that (l/3)(u + log(p / )) is an integer, since this does 
not affect the asymptotic behavior. Due to the first case, we know that the number of 
different subfunctions has to double after each input bit on the first (n/ 3) + log(p')/3 +1 
levels, i.e., each node must have two outgoing edges to two different nodes which also 
means that the all subfunctions essentially depend on the next variable. Therefore, the 
7T-OBDD has to be a complete binary tree on the first (n/ 3) + log(p')/3 + 1 levels and 
the expected 7T-OBDD size is also f2(2 n / 3 • ( p / ) 1 / 3 ). 

□ 


The following theorem shows that fc-wise independent random functions with k > 4 are 
hard even for FBDDs (and with it for OBDDs and all variable orders). The general 
strategy of the proof of the next theorem is similar to the proof in HI where the 
OBDD size of completely independent random functions was analyzed: We bound the 
probability pi that there is a variable order such that the number of OBDD nodes on 
level l deviates too much from the expected value. If Y^i=o Pi < 1 holds, then with 
probability 1 — Ym=o Pi > 0 there is no such deviation in any level of the OBDD for 
all variable orders. The differences lie in the detail: In m the function values are 
completely independent and, therefore, the calculation can be done more directly and 
with better estimations. We have to take the detour over the number of subfunctions 
which are equal (as in Theorem 3.2) and can use only Markov’s inequality to calculate 
the deviation of the expectation. Furthermore, because of the independence Wegener 
H3 was able to do a more subtle analysis of the OBDD size by investigating the effects 
of the OBDD minimization rules separately. 


Theorem 3.3. Let X 0 ,... ,X 2 n-i : S — > {0,1} be k-wise independent 0/1-random vari¬ 
ables over a sample space S with Pr [Xj — 1] = p for all 0 < j < 2 n — 1 and k > 4. For 

every s 6 S let f s : {0, l} n —» {0,1} be defined by f s (x) := X| x |(s). Then, there is an 
r-mixed function f s with r = Ll(n + log(p') — logn) with p' = 2p(l — p). 


Proof. First, we bound the probability that the number ti of subfunctions which are 
equal deviates by a factor of 5i from the expectation. Second, as in Theorem |3.2 


we 


show an upper bound on the level l for which the number of equal subfunctions is lower 
or equal than 1, i. e., the OBDD has to be a complete binary tree until this level. 

As we know, the expected number of pairs (a, a') with f a = f' a is bounded above by 
Hi \= 2 n~i. p i • Due to the dependencies, using Markov’s inequality is the best we can do 
to bound the deviation from the expectation. Thus, we have 


Pr [No. pairs (a, a') with f a = f' Q > S t ■ /p] < —. 

Ol 


Due to Theorem 2.3 the definition of the subfunctions corresponding to OBDD nodes 
on level /, i. e., the definition of the subfunctions f a , depends only on the first l variables 
with respect to the variable order. Thus, we have to distinguish only (") possibilities to 
choose these variables. Let 5i := (”) • (n + 1). Then the probability, that for all levels 
and variable orders the number of pairs (a, a') with f a = f a > is at most 5i ■ /q is bounded 
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below by 1 — n/(n + 1) > 0. Note that this also implies that ti < \/8i ■ Hi for all levels l 
and variable orders. 

As in the proof of Theorem T2 the next step consists of the investigation of two 
cases: y/Sifii < 1 and a /5iJm > 1. Here, we focus only on the first case. In other words, 
we compute an upper bound T such that y/5iHi < 1 or, equivalently, (1/2) log (Si/ii) < 0 
for all l < T. For the calculations, we need a known bound for the binomial coefficient 
log (’/) < n ■ H(k/n ) where H(x ) = —xlog(x) — (1 — x) log(l — x) is the binary entropy 
function. It holds 

^log(Ahz) < ^(3/ ™n + log(n) + 1 - log(p') +n ■ H 
Let l — e-n for some e < 1/2. We want to maximize e such that log (y/Sipf) < 0. 




-(3(en) — n + log(n) + 1 — log(p') + n ■ H(e)) < 0 

3e + H(e) < 1 


log(l/p') 1 logn 

n n n 


Using 


1 — x 


< 1 + 2x for 0 < x < 1/2 and log(l + x) < x for x > —1, we can bound 


3e + H(e) by 6^ (see Appendix for the details). Thus, if 


£ < 


1 _ p Oog(l/rt + 1 + logn\ / _ 
6 6 \ n n n ) \ 


log(l/p') + log?r 


n 


it is log < 0. Since l = e-n and the maximal £ is in U ^1 — log bAU+ lo g n j 

log < 0, there is a function f s which is r-mixed with r = fl(?i+log(p') —logn). □ 


Due to Lemma 2.5 


the last Theorem gives us an lower bound even for FBDDs. 


Corollary 3.4. Let X 0 , ... , AV-i be k-wise independent 0 /1-random variables over a 
sample space S with Pr [Xj — 1] — p for all 0 < j < 2 n — 1 and k > 4. For every s G S 

let f s : (0, l} n — > {0,1} be defined by f s (x) := X^^s). Then, there is a function f s such 
that the FBDD size is at least 2 s T n+1 °ghU -logn ). 


4 Construction of Almost k-wise Independent Random 
Functions. 

The gap between the OBDD size of 3-wise independent random functions and 4-wise 
independent random functions is exponentially large. In order to see what kind of 
random functions have an OBDD size which is in between these bounds, we show that 
a construction of a random OBDD due to m of size 0((nk) 2 /e) generates {e,k )-wise 
independent functions. The idea is to construct a random OBDD with fixed width 
w. If w is large enough, the function values of k different inputs are almost uniformly 


12 


















distributed because the paths of the k inputs in the OBDD are likely to be almost 
independent. For 0 < i < n — 1 let layer A consists of w nodes labeled by x* and layer 
L n be the two sinks. For all 0 < i < n - 1 we choose the 0/1-successors of every node 
in layer A independently and uniformly at random from the nodes in layer L i+ \. Then 
we pick a random node in layer L 0 as the root of the OBDD. 

Theorem 4.1. For w > k + nk{k + l)/e the above random process generates ( e,k)-wise 
independent random functions. 

Proof. Let ai,..., a* G {0, l} n be k different inputs and p be the probability that the 
function values of these inputs are aq, ...,«£ G {0,1}. Let Pi, ..., Pk the k paths of 
ai,... ,a k to the layer L n _i, i. e., the paths end in a node labeled by x n _i. Let Di be 
the event that the paths Pi,... ,P L end in different nodes. Since the inputs are different, 
every A has to use an edge which is not used by any other path and, therefore, it 

k k 

holds Pr [Di I A-i] > (1 - ^) n and with it Pr [D k ] = E[ Pr [A | A-r] > U (1 - ^y) n . 

i= 2 i=2 

k . k _ n 

We have na W ) — n > 1 — e for w > k + nk(k + l)/e > k + nk(k + 

i= 2 i= 2 

1 )( 1 / 111 (^ 37 )). If all paths end in different nodes, then the function values of the k 
inputs are independent and uniformly distributed, i. e., p > 2~ k ■ Pr [D k \ > — £ and 

p < 1 — (1 — 2~ k ) • Pr [Di] < 2~ k + £ which completes the proof. □ 

5 Randomized Implicit Algorithms 

Complexity Class 

Only a small modification is necessary to extend Sawitzki’s simulation results from [36J 
and |38] to show that the set of problems which can solved by a randomized implicit 
algorithm is equal to the set of problems solved by a randomized parallel algorithm. 
In the implicit setting, we just add the possibility to construct random functions r : 
{0,1}' —» {0,1} with l = 0(\ogN). Constructing such functions in parallel is easy. 
The other way round, i. e., simulating a randomized parallel algorithm by a randomized 
implicit algorithm, the only difference is the set of input variables of the circuit (which 
represents the (randomized) parallel algorithm). A deterministic circuit has only N 
input variables whereas the random circuit has additional 0(N C ) random inputs for a 
constant c. Assuming we can construct a random function r : {0,1}' —» {0,1} with 
l = 0(log N), we can set the input variables correctly for the simulation (in the same 

way as in EBP- 

Randomized Maximal Matching Algorithm 

We use the construction of 3-wise independent random functions from the last section 
to design a randomized maximal matching algorithm. Here, the main drawback of our 
random construction is the missing possibility to use different probabilities for the nodes. 
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Algorithm 2 Randomized implicit maximal matching algorithm 
Input: Graph Xe(x, y) 

Output: Maximal matching 

XAi(x,y) = 0 // Initial matching 

while xe(x, y) ^ 0 do 
XE'(x,y) = Xe(x, y) 

// Compute set of nodes with two or more incident edges 
T(x ) = Bz,y : (z ^ y) A XE'(x,y) A Xe'(x,z) 

NewEdges(x,y ) = 0 
while T(x) ^ 0 do 

// Construct 3-wise independent random functions (see Algorithm [Tj) 
fn (x) = RandomFunc(x,n ) and f r2 {y ) = RandomFunc(y,n) 

F(x,y) = (x > y) A (f ri (x) ® f r2 (y )) 

F(x,y) = F(x,y) V F{y,x) 

Xe'(x, y) = Xe'{x, y) A F(x, y) // Delete edges with probability 1/2 

T(x) = 3z,y : (z ^ y) A XE>{x,y) A xe>(x,z) // Update T(x,y) 

// Store isolated edges in NewEdges 

NewEdges(x,y ) = NewEdges(x,y ) V (xE'(x,y) f\T(x) AT(y)) 

end while 

Xivi(x,y ) = XAt(x,y ) V NewEdges(x,y ) // Add edges to current matching 

Matched(x) = 3 y : XM(x,y) 

Xe(x, y) = Xe(x, y) A Matched(x ) A Matched(y ) // Delete edges incident to 

matched nodes 

end while 
return XAi(x,y) 


Randomized algorithms for maximal independent set using pairwise independence like 
in pQ or ra choose a node with a probability proportional to the node degree. In order 
to simulate these selections by our construction, we delete each edge with probability 
1/2 as long as there are other incident edges. Finally, we add the remaining isolated 
edges to the matching. Algorithm [2] shows the whole randomized implicit maximal 
matching algorithm. We realize the edge deletions of the inner loop in the following way: 
We construct two 3-wise independent random functions f ri (x),f r2 {y) using Algorithm 
in and set F{x,y) = {x > y) A (f ri (x) © f r2 (y))- Since Pr [f ri (x) © f T2 (y) = 1] = 

r 1,7*2 

Pr [f ri (x) 7 ^ fr 2 (y)\ — 1/4+1/4 = 1/2 for inputs x < y the function F(x, y) deletes such 

ri,T2 

edges as required. Because we are dealing with undirected graphs, we want F(x, y) = 
F(y,x) for every (x,y). Therefore, we set F(x,y ) = F(x,y) V F(y,x ) and delete the 
edges with the operation Xe{x, y) = Xe{x, y) A F(x, y). 

We say that an edge e E E’ (before the inner while-loop) survives iff e E E' after the 
inner while-loop of algorithm [ 2 j 
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Lemma 5.1. For every e = {u,v} G E with deg E {u) > 1 or deg E (v) > 1 before the inner 
while-loop in algorithm 2 the probability that e survives is at least 8 .( degE ( U )+ dcg 2 ) ■ 


Proof. Let e = {u, v } G E be an edge before the inner while-loop and R e be the num¬ 
ber of rounds until edge e is deleted. The random bits in each iteration are 3-wise 
independent and the iterations themselves are completely independent. Thus, the vari¬ 
ables R e are also 3-wise independent. Denote by N(e) = {e' G E j e fl e' ^ 0} the 
neighborhood of e, i. e., all edges incident to u or v. Then we have Pr [e survives] = 

Pr [R e is unique maximum in {R e > \ e! G IV(e)}]. It is easy to see that Pr [R e — i\ = 
for i > 1. Let e! G N(e) and e' ^ e and z > 1 be hxed. Since the R e are 3-wise in- 
dependent, we have Pr [R, e > > z \ R e = z] = Pr [R e > > z] — (|)* = (|)~ . Therefore, 

i=z 

the probability that there is an edge e' G N(e) \ e with R e t > z is at most , 

i.e., R e is unique maximum with probability at least 1 — . This is greater 

than 0 for z > log(|IV(e)| — 1) + 2. Finally, we have Pr [R e is unique maximum] > 

/lxlog(|JV(e)|- 1 )+2 / _ |iV(e)|-J. \ > _1_ n 

\2/ y 2 lo s(l-^( e )l —1 )+ 1 J — 8-(degE(u)-\-deg E (v)— 2) 

The number of deleted edges for a matching edge (u, v) that is added to the matching 
is deg{u) + deg(v) — 2 if we do not count the matching edge itself. Thus, the expected 
number of deleted edges is D(|-E'|) at the end of the outer loop. This gives us the final 
result. 


Theorem 5.2. Let G = (V, E) be a graph with N nodes. All functions used in algorithm 
[| on the input xe depend on at most 3 log N variables. The expected number of operations 
is 0(log 3 N). 


Proof. Each iteration of the inner-loop needs O(log IV) operations. Since we halve the 
number of edges in expectation in each iteration of this loop, the expected number of 
iterations is O (log N). The edges surviving the inner loop are those that are added to 
the matching. After adding a set of edges to the matching, all edges that are incident 
to a matched node are deleted from the graph in the outer loop. The number deleted 
edges for a matching edge (u, v) that is added to the matching is deg(u ) + deg(v) — 2 if 
we do not count the matching edge itself. Thus, by Lemma 3, the expected number of 
edges deleted in this step is at least 


Y. ( deg E {u ) + deg E (v) - 2 ) ■ 

e={u,v}£E 


l 

8 ■ ( deg E (u ) + deg E (u) - 2) 


\E\/8. 


This implies that the expected number of iterations of the outer-loop is also bounded 
above by O (log N). □ 


Application to the Maximal Independent Set Problem 

With a similar idea we are able to design a distributed MIS algorithm: Each node v 
draws a random bit until this bit is 0. Let r v be the number of bits drawn by node v. 
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We send r v to all neighbors and include node v to the independent set iff r v is a local 
minimum. The expected number of bits for each channel is 1. A similar analysis as before 
show that we have an maximal independent set after O(logiV) steps in expectation and 
the overall expected number of bits per channel is 0(log N). 

Experimental Results. 

All algorithms are implemented in C++ using the BDD framework CUDD 2.5. (0 by 
F. Somenzi and were compiled with Visual Studio 2013 in the default 32-bit release 
configuration. All source files, scripts and random seeds will be publicly available^] The 
experiments were performed on a computer with a 2.5 GHz Intel Core i7 processor and 
8 GB main memory running Windows 8.1. The runtime is measured by used processor 
time in seconds and the space usage of the implicit algorithm is given by the maximum 
SBDD size which came up during the computation, where an SBDD is a collection of 
OBDDs which can share nodes. Note that the maximum SBDD size is independent of 
the used computer system. For our results, we took the mean value over 50 runs on the 
same graph. Due to the small variance of these values, we only show the mean in the 
diagrams/tables. We omit the algorithm by Bollig and Proger [TO] because the memory 
limitation was exceeded on every instance presented here. 

We choose three types of input instances: First, we used our construction from section 
[4] as an input distribution in the following way: If the 1 sink is chosen with probability 
p as a successor of nodes in layer L n _i the expected size of |/ -1 (a;)| is p ■ 2 n . For a fixed 
N = 2 17 , we used p as a density parameter for our input graph and want to analyze how 
the density influences the running time of the algorithms. Second, we run the algorithms 
on some bipartite graphs from a real advertisement application within Googlcj^] [22] • The 
motivation was to check whether the randomized algorithm is competitive or even better 
on instances where the algorithm by Hachtel and Somenzi (HS) [20] is running very 
well. Third, we use non-bipartite graphs from the university of Florida sparse matrix 
collection [16J. Since HS is designed for bipartite graphs, a preprocessing step computing 
a bipartition of these graphs are needed to compute a maximal matching (see, e. g., ma) 
while our algorithm also works on general graphs. 

In the experiments we use the following implementation of our algorithm denoted by 
RM. In order to minimize the running time for computation of the set of nodes with 
two or more incident edges, we sparsify the graph at the beginning of the outer while 
loop by deleting each edge with probability 1/2 and repeating this D times. Initially, 
we set D = log \E\ and decrease D by 1 at the end of the outer loop. Asymptotically, 
the running time does not change since after O(log IV) iterations, i.e., D — 0, it does 
exactly the same as original algorithm. Initial experiments showed that this is superior 
to the original algorithm. 


1 http://vlsi.Colorado.edu/~fabio/CUDD/ 

^http://ls2-www.cs.uni-dortmund.de/~gille/ 

3 Graph data files can be found at http://www.columbia.edu/~cs2035/bpdata/ 
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Instance 

Nodes 

Edges 

Time (sec) 

Space (SBDD size) 

333SP 

3712815 

22217266 

1140.54 

66968594 

adaptive 

6815744 

27248640 

403.82 

22767094 

as-Skitter 

1696415 

22190596 

337.53 

32020282 

hollywood-2009 

1139905 

113891327 

418.36 

62253086 

roadNet-CA 

1971281 

5533214 

136.18 

13177668 

roadNet-PA 

1090920 

3083796 

75.26 

7633318 

roadNet-TX 

1393383 

3843320 

92.62 

9125438 


Table 1: Running time and space usage of RM on the graphs from [IB] 



Graph Number 



Graph Number 


Figure 2: Running times of HS and RM on the real world instances. 

On the random instances the running time and space usage of RM was more or less 
unaffected by the density of the graph while HS was very slow for small values of p 
and gets faster with increasing density. For p < 0.2 RM was much faster than HS (see 
Fig.[3][4]). In Fig. 1 we see that on the bipartite real world instances RM is similar to 
HS if the running time is negligibly small but on the largest instances (number 15 to 
20) RM is much faster, the graphs from [16] were intentionally chosen to show the 
potential of RM and indeed do so: It was not possible to run HS on these graphs due 
to memory limitations whereas RM computed a matching in reasonable time and space 
(see Tablejl]). Both graphs from and [16] have very small density and the experiments 
on the random graphs seem to support the hypothesis that RM is a better choice than 
HS for such graphs. 
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Figure 3: Running times of HS and RM on the random instances. 
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Figure 4: Space usage of HS and RM on the random instances. 

Further Applications. 

Extending our matching algorithm to the more general /-matching, where each node 
v is allowed to have at most f(v) incident matching edges, is an interesting question. 
Designing other randomized implicit algorithms, e. g., for minimum spanning tree, where 
random sampling of subgraphs are necessary, seems straightforward and initial exper¬ 
iments showed that this could lead to faster algorithms than the known deterministic 
ones. 
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Proof of Theorem 13.3 

Claim .3. Let e < 1/2. Then 3e + H[e) < 6 y/e. 


Proof. Recall that H{x) = —xlog(x) — (1 — x) log(l 
0 < x < 1/2 and log(l + x) < x for x > — 1 we have 


x). Using 


l — x 


< 1 + 2x for 


3e + H(e) 


= 3e + elog(l/e) + (l-e)-log(l/(l 

< 3e + e^Jlje+ \og{ll(l - e)) 

< 3e + \fe + 2e 

< 


e )) 


□ 


Experiments 


Number 

Running Time (RM) 

Running Time (HS) 

SBDD Size (RM) 

SBDD Size (HS) 

0 

0.243 

0.475 

567210 

1346996 

1 

0.264 

0.571 

555968 

1394008 

2 

0.256 

0.567 

553924 

1394008 

3 

0.059 

0.066 

153300 

220752 

4 

0.055 

0.041 

161476 

194180 

5 

0.042 

0.043 

153300 

194180 

6 

0.064 

0.067 

196224 

252434 

7 

0.042 

0.073 

163520 

279006 

8 

0.055 

0.072 

169652 

279006 

9 

0.09 

0.12 

240170 

368942 

10 

0.099 

0.11 

237104 

368942 

11 

0.105 

0.17 

245280 

368942 

12 

0.067 

0.052 

236082 

245280 

13 

0.058 

0.07 

242214 

310688 

14 

0.091 

0.066 

284116 

328062 

15 

2.565 

6.259 

3115056 

7887796 


Table 2: Running times and space usage of RM and HS on real-world instances from 

ra- 
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Number 

Running Time (RM) 

Running Time (HS) 

SBDD Size (RM) 

SBDD Size (HS) 

16 

2.545 

6.167 

3115056 

7874510 

17 

4.002 

6.329 

3115056 

7874510 

18 

1.112 

1.81 

2053198 

2320962 

19 

0.913 

2.043 

2035824 

2485504 

20 

0.828 

1.931 

2035824 

2485504 

21 

0.073 

0.036 

182938 

231994 

22 

0.059 

0.046 

163520 

240170 

23 

0.095 

0.036 

162498 

240170 

24 

0.043 

0.022 

134904 

134904 

25 

0.037 

0.021 

135926 

135926 

26 

0.058 

0.018 

169652 

135926 

27 

0.203 

0.331 

346458 

731752 

28 

0.188 

0.348 

317842 

677586 

29 

0.244 

0.305 

319886 

677586 

30 

0.632 

1.176 

1314292 

2100210 

31 

0.568 

1.114 

1280566 

2104298 

32 

0.458 

0.568 

950460 

1410360 


Table 3: Running times and space usage of RM and HS on real-world instances from 

ra- 
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Figure 5: Standard deviations of the running times. 
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Figure 6: Standard deviation of the space usage. 
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Number 

\u\ 

\w\ 

Edges 

0 

136 

18872 

222951 

1 

137 

18872 

222951 

2 

137 

18888 

222951 

3 

40 

7086 

33609 

4 

41 

7086 

33609 

5 

41 

7093 

33609 

6 

125 

7107 

33609 

7 

86 

7117 

33609 

8 

86 

7127 

33609 

9 

289 

16653 

33051 

10 

290 

16846 

33051 

11 

290 

16904 

33051 

12 

50 

13360 

50040 

13 

51 

16264 

56577 

14 

51 

21016 

56577 

15 

164 

288826 

2523313 


Number 

\u\ 

M 

Edges 

16 

165 

288826 

2523313 

17 

165 

288858 

2523313 

18 

196 

89030 

1080027 

19 

197 

89044 

1080041 

20 

197 

89044 

1080041 

21 

40 

28489 

43629 

22 

41 

28944 

43629 

23 

41 

28944 

43629 

24 

35 

11361 

22279 

25 

36 

11588 

22279 

26 

36 

11695 

22279 

27 

934 

8752 

42711 

28 

935 

8896 

42711 

29 

935 

9028 

42711 

30 

125 

55058 

844598 

31 

126 

56858 

844598 

31 

126 

57926 

477356 


Table 4: Properties of the real-world instances from [32J- 
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